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Abstract 

The movements of birds, bats, and other flying species are governed by complex sensorimotor 
systems that aUow the animals to react to stationary environmental features as well as to wind distur- 
bances, other animals in nearby airspace, and a wide variety of unexpected chaUenges. The paper and 
talk will describe research that analyzes the three-dimensional trajectories of bats flying in a habitat in 
Texas. The trajectories are computed with stereoscopic methods using data from synchronous thermal 
videos that were recorded with high temporal and spatial resolution from three viewpoints. Following 
our previously reported work, we examine the possibihty that bat trajectories in this habitat are governed 
by optical flow sensing that interpolates periodic distance measurements from echolocation. Using an 
idealized geometry of bat eyes, we introduce the concept of time-to-transit, and recall some research 
that suggests that this quantity is computed by the animals' visual cortex. Several steering control laws 
based on time-to-transit are proposed for an ideaUzed flight model, and it is shown that these can be used 
to repUcate the observed flight of what we identify as typical bats. Although the vision-based motion 
control laws we propose and the protocols for switching between them are quite simple, some of the 
trajectories that have been synthesized are qualitatively bat-like. Examination of the control protocols 
that generate these trajectories suggests that bat motions are governed both by their reactions to a subset 
of key feature points as weU by their memories of where these feature points are located. 

I. INTORDUCTION 

This paper describes research aimed at using observed flight trajectories of a species of bats 
to understand the ways in which the animals use sensory perceptions of their envirormients 
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to control their motions. The work is based on data recovered from a large collection of 3- 
dimensional video records of Myotis velifer, emerging from a cave on the Bamberger Ranch 
Preserve in Johnson City, Texas. These are cave-roosting bats that live in southern North America 
and Central America and are a large bodied species of the Myotis genus, weighing about 14 
grams and having a wingspan of 30 cm ([[61, 13). 

Bats perceive features within their environment using complex combinations of sensory organs. 
Many species, including the M. velfer studied in the present paper, are able to perceive distances 
to objects by means of echolocation. It is likely, however, that vision also plays a role in guiding 
the these animals as they fly. Similar to other Yangochiroptera (microbats), M. velifer have 
relatively small eyes that are principally directed sidewards from opposite sides of the head. 
Their retinas are rod-dominated, making them well suited to their nocturnal niche. In addition, 
their retinas contain dense horizontal connections but few vertical connections, which suggests 
that they are specialized to detect motions and contours under nocturnal illumination at the 
expense of high feature discrimination acuity [fTTl . However, contrary to traditional belief that 
bats possess a simplistic visual system, recent evidence suggests that several bat species, including 
M. velifer, have functional S opsin genes [[T6l . It is unclear whether these genes are expressed in 
M. velifer retinae, but the presence of functional genes suggests that M. velifer may be able to 
see UV light and thus possess mesopic vision that is effective at dusk and dawn and on brightly 
moonlit nights [|25l . The optic nerves of M. velifer' s left and right eyes remain separate. Each 
optic nerve crosses over completely to the contralateral side of the brain [fTTl . This anatomical 
characteristic suggests that, at least at the lower level, information from each eye is processed 
separately by the brain. 

The research presented in this paper is part of a growing body of work aimed at understanding 
the sensorimotor motor control of flying animals. We refer to [fTH . lfTSll .lfTl. and flU for examples. 
In the following sections, simple models of vision-guided horizontal flight control are proposed 
and evaluated in terms of their potential for explaining the observed motions of M. velifer bats. 
The organization is as follows. Section [ll] describes the processing of video data and the computer 



rendering of observed bat trajectories. Section III discusses the concept of time-to-transit, how 



this can be determined from the flow of feature images on the retinas of animals in flight, and the 
emerging evidence that animals use perceptions of time-to-transit to guide their flight behaviors. 



Section IV proposes what we have called single feature and paired feature control laws that are 
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based on optical flow and that can be used to steer a simple model vehicle in a way that has 



under various assumed environmental sensing protocols that exhibit characteristics of bat flight, 
and Section |VI] draws some conclusions about what can be learned from detailed observation 
of animal flight behaviors coupled with flight control simulations. We also discuss the need for 
further research to understand broader classes of vision-based control as well as the use of hybrid 
sensing whereby vision and echolocation are used synergistically. 

II. Recovery of flight paths from 3 -dimensional video records 

Using high-resolution thermal video recordings of M. velifer emerging from a cave on the 
Bamberger Ranch in Texas, three-dimensional reconstructions of 405 different trajectories were 
created [16, 19]. Errors inevitably appear in these reconstructions due to uncertainties arising from 
bats flying outside the 3D calibration region, from occasional occlusions, and from misidentifying 
homologous points on the bat's body in the three views, especially when its size in at least one 
view is small. Smoothing and filtering were carried out along the lines discussed in ||5l but in 
this case using cubic spline smoothing jl(-) with a smoothing factor A = 0.85. (See [|24t.^ 



Over the range of the parameter, 0<A<1,A = corresponds to a linear least squares fit to the 
data, while A = 1 corresponds to a cubic spline interpolation passing through every data point. 
The parameter A is chosen such that the smoothing is good enough for noise cancellation without 
loosing too much information. Since the goal is to understand the aggregate flight characteristics 
of the bats, the smoothed trajectories were parameterized by arc length and truncated to have a 
common length from the point at which they entered the field of view to the point at which the 
image resolution was overly noisy because of its distance from the cameras. The smoothed and 
reparameterized trajectories were then filtered to remove those that exhibited anomalies such 
as leaving the field of view prematurely. Finally, over the 254 trajectory segments that were 
retained for study, it was noted that the bats descended at a fairly steady rate so as to follow 
the descending slope of a hill. These trajectories appeared to be largely confined to a plane, 
with only small deviations above or below. Hence our initial attempt to understand how the 
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bats' sensory perceptions were guiding their movement has been focused on models of motion 
control in this plane. 

The planar projection of the smoothed and filtered trajectories is shown in Fig. [1} The cameras 
that recorded the flights were located just outside and to the left of the rectangular region 
displayed in the figure. The bats entered the field of view of the three video cameras from the 
left. At the top of the figure, the small triangles correspond to trees in a wooded area, and at 
the center of the figure there are two significant features labeled vine and pole. The vine is a 
natural feature that runs from the ground up to a fairly high tree branch so that the bats must 
fly either to the left or the right of it. The pole was placed as a vertical marker to calibrate the 
cameras, and its height was such that bats could either fly over or around it. 

We initially subdivided the 254 trajectories into six groups depending on whether they went 
around the vine on the left or right together with whether they flew to the left, right or over 
the pole. Visual inspection suggested that the differences among the trajectories with respect to 
the pole were insignificant. Thus we divided the set of trajectories into two classes: the first 
comprised of 115 bats who flew to the left of the vine and the second being the 139 bats who 
flew to the right. Having parameterized all trajectories by arc length, we adopted the viewpoint 
that we could recreate the flight path of a "typical bat" by computing mean trajectories within 
each class. Fig. [5] below displays the mean path of the 115 bats who flew to the left of the vine 
in red, and the mean path of the 139 bats who flew to the right of the vine in blue. The green 
curve was synthesized by a flight control law that will be discussed in Sections IV and |Vj The 



green flyer reacts more strongly to perceived environmental features than a typical bat would. It 
is interesting to note that although the red, blue, and green paths all deviate from one another, 
they rejoin at the end of the flight domain. To justify averaging as a way to create a typical 
trajectory, more analysis of the path statistics, including the consistency of speed profiles along 
the paths, is needed. This analysis has been carried out, but it is beyond the scope of this short 
paper and will appear elsewhere. 

III. Review of motion control using optical sensor feedback 

Sebesta and Baillieul [18] showed how the well-known optical parameter r could be used to 
guide the motion of a moving optical sensor. It is worth redoing this analysis with a special 
emphasis on the eye geometry of the M. velifer. In lfT4l and ifTSl . r was described in terms 
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Fig. 1. Smoothed and projected trajectories. In tiiis schematic rendering, the bats emerging from the cave enter on the left 
and fly to the right until they are effectively out of range. The trajectories are rendered in different colors that reflect where the 
bats flew with respect to the vine (which they had to pass on the left or the right) and the pole (which they could fly around 
or over). The triangles are visual features in the woods — mainly points on tree branches. 



of a geometric picture that is most appropriate for animals (like humans) that have a forward- 
facing field of view. The eyes of the M. velifer are shifted toward the sides of the head, greatly 
expanding their field of view and, at the same time, giving them higher acuity in resolving 
objects that are off to one side or the other ( IfTOl ). Because of the placement of their eyes and 
due to neural connectivity patterns of their photoreceptors, these bats have enhanced ability to 
orient themselves with respect to features in the lateral visual field. We conjecture that the bats 
may use optical flow sensing of features in the lateral field to guide their motions. In order to 
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explore this, we introduce the concept of time-to-transit and discuss how time-to-transit is easily 
determined from the movement of feature images on an animal's retina or on the image plane 
of a camera. Consider the idealized planar vehicle depicted in Fig. |2j (Since we are interested 




Fig. 2. Optical flow of feature images for a sideward-looking imaging system. 



in planar rendering of observed animal trajectories (per Section |ll]), models of motion in the 
plane are appropriate.) The direction of motion is aligned with the vehicle body frame x-axis, 
and the feature O is observed with a pinhole camera system whose camera axis is aligned with 
the negative body frame y-axis. The image of the point feature O is at di, a negative quantity 
as it is depicted in the figure. 

We suppose the vehicle moves in the direction of its body frame a;-axis at a constant speed 
V. If the motion is initiated at a point Xq along the line of flight at time t = 0, it will cross a 
line that is perpendicular to the line of flight and passes through the feature point O at time 
t = xq/v. This quantity is called the time-to-transit, and we denote it by r. We note that as the 
figure is drawn, the image point corresponding to the feature in our idealized camera lies at d^ 
in the body frame x-axis, and the focal point lies at — / on the body frame y-axis. (/ is the 

camera focal length.) It is clear that the similarity of triangles implies the relationship 

d _ f 

x{t)-d,{t) d,{ty 

and from this it follows that 

di V 
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This is zero when t = xq/v (the time at which the vehicle crosses the line perpendicular to its 
path and passing through O). At t = 0, we see that di/ di = xq/v = t h the time-to-transit. The 
general conclusion is that if di{t) is the location of an image feature, r(t) = di{t)/di{t) is the 
time remaining until the camera is directly abeam of the actual feature, provided that the speed 
and heading are held constant. 

This simple argument is very similar to the way in which r was introduced in [[T4| and [fTSl . 
but with an extremely important difference. The analysis in [fT4ll and [|T8l was carried out for a 
forward-looking imaging system, whereas here we have treated a side looking imaging system. 
For forward-looking imaging systems, when the vehicle or animal transits the line to the feature 
point, the image point will have disappeared from the field of view — going outside the range 
of peripheral vision. For side looking eyes (cameras), however, the images of features being 
transited will be located near the camera focal point or at the fovea centralis — the point on the 
retina where visual acuity is greatest. This suggests that animals like bats will have an acute 
awareness of objects that are to one side of their flight paths. 

Terms such as "looming" and "time-to-collision" have appeared infrequently in the literature 
of mobile robot control, with notable exceptions being fi5\, and [fT8l . Nevertheless, there is a 
growing literature dealing with biological sensorimotor control in which vision based sensing 
of the time-to-transit key feature points is seen as playing a central role in regulating motion 
behaviors ([[T2ll,||T4l,[|26l). 



IV. Distance maintenance using optical flow 

In [fT8| , we showed that the difference between times-to- transit for two separated features 
could be used as a feedback signal to guide a vehicle along a path between them. We now turn 
our attention to the problem of using optical flow to steer a vehicle along a path lying a short 
distance outside the boundary of an array of obstacles. The question we would like to answer 
is whether paths that resemble our reconstructed bat motions can be generated. Consider the 
vehicle motion at constant speed v that is depicted in Fig. [3j The features Oi and O2 are d 
units of distance from one another and register in the vehicle's side looking imaging system that 



was described in Section |in| It is clear that the difference between the transit times T2 and ti is 
given by dcos(^/v, and this difference will be maximized when = 0. In other words, if the 
movement can be controlled in a way that ensures that T2 — ti is maximized, the direction of 
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Fig. 3. The difference between T2 and ri is maximized if the line of travel is parallel to the line segment joining 0\ and 02- 



travel will be aligned with the line segment from Oi to 02- 

It is well established that animals are good at following sensory gradients (Il8ll. [|20]| ). Because of 
this, we have adopted a working conjecture that the bat trajectories discussed in Section |Il] follow 
the edge of a wooded area by means of maximizing differences in time-to-transit of features along 
the boundary. (See Fig. [T|) To prove that this approach to navigation is theoretically feasible, 
we note that apart from our observation that the time-to-transit can be determined entirely from 
the optical flow that is sensed by a side-looking imaging system, it is also noted as in [fTSl that 
time-to-transit is a purely geometric quantity. Referring to Fig. [2[ we adopt a simple kinematic 
model of planar motion 



y 



^ V COS 6 ^ 



v 



(2) 



V sin^ 
u 

where v is the forward speed in the direction of the body-frame x-axis, and u is the turning 
rate. By carrying out an analysis that differs from [18] only in minor details, we find that the 
time-to-transit a feature located at {xw, Vw) in the world frame by a vehicle traveling at constant 



March 14, 2013 



DRAFT 



9 



speed V and having configuration {x, y, 6) (in world frame coordinates) is 

cos 6 {xyj — x) -\- sin 6 (|/^ — y) 



(3) 



V 

Assuming the feature point {x^, yw) is fixed in the world frame and letting only d vary, we find 
that T = t{6) is maximized when the vehicle is aimed directly at the feature point. On the other 
hand, for two separated features Oi, O2 located at (xi, yi), {x2, 1/2) respectively, the heading that 
maximizes the difference in times-to-transit, T2{9) — ti{6), is clearly aligned (as noted above) 
with the direction {x2 — xi, y2 — yi), and at this heading we have T2{0) — ti{9) — 0. 

Theorem 4.1: Consider point features O-i, O2 located respectively at (xi, yi) and (^2, ^2)- Let 
Tj{t) be the time-to-transit associated with feature Oj for j = 1,2. Suppose the initial orientation, 
^^0, of the vehicle is such that T2 > ti (which implies that cos 9 {x2 — xi) + sin 9 (1/2 — yi) > 0). 
Further assume that the vehicle travels at constant speed v = 1. Then for any A; > 0, the steering 
control 

u^u{t)^k[r2'{9{t))-n'{9{t))i (4) 

where Tj{9) = will asymptotically align the vehicle with the line segment directed from Oi 
to O2 

Proof: Let {vx,Vy) designate the planar direction from feature Oi to O2: 

X2- Xi \ 1 




y2 - yi 



\/{x2 - a;i)2 + (1/2 - ?/i)2 



The function V{9) — 1 — cos 9vx — sin 9 Vy will serve as a Lyapunov function with Lie derivative 

jOuvm) = f 

= —kp{—sm9vx + cos9vyy, 

where p — ■\/{x2 — x^Y + (^2 — ViY- The set V{9) < 1 is compact and invariant under the 
motion, and by LaSalle's theorem the motion evolves asymptotically toward the set 

{9 : V{9) < 1} n : C^V{9) = 0}. 

The unique value of < < 2n, lying in this set is such that (cos sin 6*) = {vxiVy). This 
specifies that the asymptotic direction of the motion is aligned with the Une from Oi to O2 as 
stated in the theorem. ■ 
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Remark 1: The theorem is conservative in the sense that the hypotheses are intended to restrict 
the initial conditions to configurations in which the moving vehicle has a non-zero component of 
its motion in the direction of the line from Oi to O2. If the vehicle had access to its orientation 9 
in space and to the world-frame coordinates of the features ( {x2,y2) ), then the control 
law ^ could be written u{t) = k[— sinO (x2 — xi) + cos^^ (?/2 — Vi)]- Assuming the system has 
access this global configuration information, the control law will steer the vehicle to alignment 
with the feature from every initial configuration except those in which the initial has the 
vehicle aligned with the direction (a;i — X2,yi —1/2) (i-C- aligned in exactly the opposite direction 
from the goal alignment of the theorem). The existence of this singular direction is a familiar 
characteristic of kinematic control laws for vehicle models of the form (|2]), Q. 

Remark 2: We note that the value of r that is associated with a visible feature as specified in 
(|3]) is a purely geometric quantity. It will be negative in the case that the feature lies behind the 
vehicle on its current line of flight. For side looking eyes, it could still be visible, and would be 
perceived as being both negative and becoming increasingly negative as the motion continues. 
The important point is that the control law Q does not assume that either feature lies ahead of 
the vehicle on its current heading. 

Remark 3: The theorem states what is achieved by keeping the difference T2 — ti at its 
maximum value. How flying animals might detect this maximum is not understood, but we 
speculate that small magnitude saccadic eye movements might be used as an energy efficient 
means of detecting what corrections to the vehicle's heading are needed to keep T2 — ti at its 
maximum value. 

Remark 4: (Model validity) Field observations together with the unsmoothed reconstructed 
flight data make clear that the relatively smooth trajectories that are produced by the model 
^ do not capture the continual rapid, short-distance lateral, pitching, and rolling motions that 
make the animal flight movements anything but smooth. It is our working assumption that these 
high-frequency deviations from smoothness can be thought of as noise that can be ignored in 
our initial attempt to synthesize vision-based bat- like trajectories. 

A. Distance-keeping to a curved row of objects 

To study the curvature of trajectories prescribed by Q, we normalize the problem such that 
= (0,0), (0:2,1/2) = (IjO) and v = 1. The steering control is then written u{t) = 
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Fig. 4. Optical flow sensing can be used to guide the idealized veliicle to maintain a constant distance (daslied line) from 
three noncolinear obstacles A, B, and C. Here there are three trajectory segments: the maximized difference of time-to-transit 
is used to align the vehicle with features A and B on the first (red line); then time-to-transit with respect to feature B is held 
constant (blue), and finally, the control law returns to maximizing the difference of time-to-transit to align the trajectory with 
the line from B to C (green). 



— k sin 6{t). Note that this is just the curvature. It follows as a corollary of Theorem 4.1 and 
Remark 1 that for 7^ tt, the absolute value \u{t)\ is a monotonically decreasing function that 
asymptotically approaches zero. The rate of decrease is determined by the gain parameter k, and 
for any threshold a > 0, we can explicitly compute the time Ta{k) at which \u\ becomes less 
than a. This is made precise in the following. 

Theorem 4.2: Consider the trajectory (|2]) prescribed by f = 1 and the steering law 



u{t) = -k sme{t). 



(5) 



Let A; > and < a < A;| sin6'o|. Then \u{t)\ is a monotonically decreasing function that takes 
on the value a at time t = Ta{k), where 



Taik) 



1 

k 



log 



log ( tan ( - sin 
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Proof: First we note that the steering equation 

e = -A; sine, ^(0) = 60 
can be integrated exphcitly in closed form to give 

9{t) = 2tan-i (^tan(y)e-* 
The signed curvature of the trajectory generated by ([2]) is given by 
K,{k,t) = u{t) = —k sin 



_-kt 



2 tan ^ ytan{ — ) e 

For each k, as noted above, K(k, t) is a monotonically decreasing function of t so that for each 
a with < a < A; | sin(6'o)|, we have a unique solution t > to the equation a = K(k,t). 
Elementary but slightly tedious algebra yields this solution as 

1 



ta — T^{k) ^ 



log {j)-^og (tanQsin-^ (^))) 



proving the theorem. ■ 
The theorem is useful in understanding the time required for the control law Q to align the 
flight path with a given straight line direction. Another potentially useful control law that can be 
based on sensed optical flow is one that keeps the time-to-transit fixed at zero. Consider three 
features forming the vertices of a triangle as depicted in Fig. |4j The vehicle ([2]) can be steered 
around the three features by using the following control protocol. First, assuming the vehicle 
starts at or below the dashed line segment through feature A, apply control law law (|4]) (more 
precisely, the control u{t) = k [TB'{0{t)) — TA{0{t))]) so that it aligns itself with the segment AB. 
As soon as the condition = is met (i.e. when the vehicle transits the dashed line through B 
that is perpendicular to its line of travel), the vehicle switches to a control to keep TB^t) = 0. This 
will cause the vehicle to execute a circular arc that maintains a constant distance from feature 
B. This control continues to be applied until the difference rc(t) — TB{t) attains a maximum 
value, at which time the vehicle switches to the control law u{t) = k [Tc'{9{t)) — TB'{9{t))]. It 
will continue in this way in a direction parallel to the segment BC at the same distance to the 
side of the segment. In terms of the notation of Table 1, the path segmentation is prescribed by 
Ud[A,B;t] Uc[B;t] — )• Uii[B, C]t], with the notation that will be explained in the next section. 

Again, it is important to emphasize that we have not attempted to incorporate neurologically 
based models of how bats might sense that transit time differences are at a maximum value or 
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how they might fly so as to keep a transit time constant. Optimum seeking control laws and 
control laws that steer vehicles so as to keep sensed quantities constant are well known ([O), but 
the details of how such control can be carried out using vision and other sensing by the animals 
remains an open question. In the next section, we consider a number of vision-based control 
strategies that give rise to flight paths resembling the bat trajectories described in Section |Ilj 

V. Flight simulations for understanding feature based animal navigation 

A complete understanding of the sensorimotor dynamics that produce the flight patterns 
described in Section |Il] remains a distant goal. Nevertheless, it is of interest to discover what 
can be learned from trying to reproduce animal-like trajectories with suitably tuned versions of 
the simple control laws and protocols that have been discussed in the preceding sections. At 
the outset, there are two related but fundamentally different questions. First, how closely can 
we come to producing a "typical" bat trajectory using an idealized flight vehicle with various 
vision-based control laws of the form we have described. Here the term "typical trajectory," 
refers to the mean trajectories described in Section |Ilj The second question, which may be more 
difficult, is can we produce simple models and protocols that predict and replicate the variability 
among the bats in this simple setting. This is to say, can we find control laws and protocols 
such that all 254 trajectory reconstructions can be reproduced by simple variations of the model 
parameters. 

In addressing these questions, we are considering what we call single feature and paired 
feature optical flow based control. An example of the former is the circling control law (keeping 
time-to- transit a feature constant), and examples of the latter are the control law (|4]) and the 
time-to-transit based law proposed in [fTSlI for flying between two features. These laws may be 
unrealistically simple, and if it is indeed the case that animals navigate by means of optical flow 
and other forms of visual feedback, the numbers of features they react to at any given instant 
of a flight may be quite high. As we previously reported ( liTSl ), sparse optical-flow algorithms 
(BRISK and FREAK) are being studied together with approaches to extracting meaningful control 
actions based on the output of such algorithms. This work is beyond the scope of the present 
paper. 

We turn instead to considering whether an appropriately sequenced set of single feature and 
paired feature vision-based control control laws can produce an animal-like trajectory in the 
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Time-to-Transit vision-based steering controls 


Uc[0;t] 


single-feature control 
— feature circling 


keeps To constant 
follows circular arc at 
constant radius from 
feature O, 




paired-feature control 
— distance maintenance 


aligns with the line 
segment from d to O2', 
see Thm. 4.1. 




paired feature control 

— steers between features 


control law from 1181 
to steer vehicle on 
path between d, 02. 



Table 1 



habitat described in Section |ll} While the analysis of [fTSll and Section |W] above characterizes 
the motions produced by each control law in Table 1 , the key to constructing complete flight paths 
will be the creation of biologically meaningful rules and protocols for switching between these 
laws. For the case of M. velifer, it is known that echolocation is the dominant distance sensing 
modality, and even in the case that the animal motions described in Section [II] are governed 
primarily by vision-based steering, it is likely that some distance information from echolocation 
plays a role in determining the flight paths. It is worth noting, however, that M. velifer may be 
using visual distance cues to supplement what is obtained from echolocation. For animals with 
sideward-looking eyes, the time-to-transit associated with any feature O is independent of 
how far off to the side of the flight path the feature lies. Visual cues for this exist, however. 
Elementary geometric consideration regarding the schematic of Fig. [2] show that in the final 
instant before transit, the image of a distant feature will lie realtively much closer to the fovea 
centralis (center of focus) than a nearby feature. At this point, our research is agnostic about how 
the animals detect distance to features, but a detailed statistical analysis of the 254 trajectories 
chosen for study indicates that distance to key feature points has a significant effect on the 
geometry of the flight paths. 

We conclude the paper by discussing the synthesis of two different trajectories using sequences 
of the control primitives listed in Table 1. Biologists have been interested for some time in the 
question of whether navigation strategies are cue-directed or rely more on spatial memory [19|. 
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Fig. 5. The tree features are those on the boundary of the wooded area depicted in Fig. [T| The green trajectory has been 
generated using the distance-keeping control described in the text. The red curve is the average of the bat trajectories that avoided 
the vine obstruction on the left, while the blue curve is the average of those that passed on the right. It is interesting to note 
that the averaged bat trajectories do not make the same excursion into the woods, but that all trajectories come together at the 
end of the observed flight sequence. 



The cue-directed strategies employ sensed cues from the environment to choose the route of 
travel while the spatial memory strategies have the bats using a learned topological or even 
metric representation of their environment to choose their route. Evidence can be found that 
both strategies are employed by animal flyers. For instance, it has been found that Eptesicus 
fuscus use acoustic landmarks for spatial orientation [9J. Bats can quickly locate a net opening by 
using a landmark even though the locations of the landmark and the net are changed (their relative 
positions are fixed). It has also been found that Glossophaga commissarisi primarily use spatial 
memory to locate food targets even though they remember both spatial and object attributes of 
their target iBTTl . It is likely that bats used both strategies during their navigation: the spatial 
memory strategy stores a coarse-grained representation of the environment and achieves long- 
term goals, such as arriving at a feeding ground, while the cue-directed strategy stores information 
of sensory features of the landmarks (nodes of the spatial representation) and achieves short-term 
goals, such as arriving near a landmark or avoiding obstacles. 

We turn to the question of how these navigation strategies can be interpreted and understood 
in terms of the sensorimotor laws proposed above. If there are synthesized trajectories that are 
well matched to the observational data, these may provide evidence to support the animals' 



March 14, 2013 



DRAFT 



16 



use of one or the other navigation strategies. We thus seek to synthesize trajectories under two 
different hypotheses: 

1) Cue-directed Strategy With this strategy, bats generate their control based purely on sensory 
information about environmental features (tree trunks and branches and the two obstacles 
[vine, polejin our case). This strategy can be understood as a stimulus-response type 
control. 

2) Integrated Strategy With this strategy, bats use landmarks specified by their spatial mem- 
ory to select features from their environment and then generate control based on these 
filtered features. This strategy can be understood as a hierarchical control with landmarks 
and spatial memory specifying sub-goals or switching points and local sensory features 
regulating lower-level control. 




-4 -2 2 4 6 8 10 12 14 16 

x(m) 



Fig. 6. Mean bat trajectories (solid curves), synthesized trajectories based on Hypothesis [T| (curves with circles) and synthesized 
trajectories based on Hypothesis |2] (curves connecting squares). Features used for navigation under Hypothesis [T] are marked by 
black circles. The subset of features used under Hypothesis |2] are marked by circles with green interior. Red and blue curves 
correspond to groups of bats passing the vine and the left and the right, respectively. 

Fig. [6] shows the synthesized trajectories based on these two hypotheses as well as the mean bat 
trajectories for groups of bats passing the vine from the left and the right. Three types of control 
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laws from Table 1 are used in the syntheses of these trajectories: the distance maintenance control 
law Ud[Oi, O2], the circling control law Mc[Oi] and the safe passing control law Up[Oi, O2], where 
Oi and O2 are the features used in a particular control law. Notice that as stated before Ud and 
Up act on feature pairs while Uc acts on a single feature. The four trajectories are generated by 
the following sequences of controlled motion segments: (Feature labels A, B, . . . refer to Fig. |6] 

1) Red curve with squares: Mp[A,vine] -> Ud[A, B] — Ud[B,C] — )• 'Uc[pole] — )■ Ud[E,F] 
Ud[-,-] for the remaining features; 

2) Blue curve with squares: nc[vine] — )■ Ud[B,C] — t- Mc[pole] — )■ Ud[E,F] — > Udf'j'] for the 
remaining features; 

3) Red curve with circles: Up[yl, vine] — Ud[A, B] — )■ Ud[B,C] — )■ Uc[C] — > Ud[C,D] — )■ 
Ud[-,-] for the remaining features; 

4) Blue curve with circles: Mc[vine] — )• Ud[B,C] — )■ Uc[C] Ud[C,D] — )■ 'Ud[-, ■] for the 
remaining features. 

As shown by the relatively high rise of the circle-interpolated curves in Fig. [6], if a cue- 
directed strategy is adopted by the bats, after passing point C, both of these two groups would 
keep following the edge of the woods. On the other hand, if an integrated strategy is adopted by 
the bats, after passing point C, the bats can use their spatial memory or the memorized sensory 
features of significant landmarks (such as the trees marked as E and F) for navigation and then 
use these features to generate their control. Using the integrated strategy, instead of continuing 
to follow the border of the woods, the bats would take a short cut. By comparing the synthesized 
trajectories based on these two hypotheses and the mean bat trajectories, it can be found that 
the trajectories based on the integrated view fit the observed mean trajectories better. Such an 
observation suggests that the bats indeed adopt an integrated strategy for their navigation. (A 
pure spatial memory strategy can be rejected by the observation that none of the bats collided 
with the pole, which was placed there by the researchers during the experiment and unlikely 
memorized by the bats.) 

An advantage of the integrated strategy over the cue-directed strategy is its time and energy 
efficiency. By taking the short cut (optimized route) instead of strictly following the forest edge, 
the bats can save flight time. In addition, by developing a stereotypical flight route — which 
is observed in our data and other experiments [21] — and efficient sensorimotor coordination. 
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the bats can also save energy. Flight is an energetically costly mode of locomotion ([22J). In 
addition to the metabolic demands of flight, many of the individuals roosting in these summer 
colonies during the time of filming were lactating females that are allocating significant energy 
resources to parental care ([|7]|, [fT3l ). Thus, a behavior that limits energy expenditure by exploiting 
shortcuts should be favored, even though these individuals are more susceptible to predation by 
aerial carnivores. It is important to note, however, that dealing only with mean behavior may give 
a misleading picture of the characteristics displayed by the animals. They exhibit considerable 
diversity in the way they react to features in the environment, and this is noted in Fig. [7} Clearly 
a significant percentage of the paths is consistent with the hypothesis that they are replying on 
perceived features to navigate. 

O o 

5- O 

O 

4 - 

O 




-4 -2 2 4 6 8 10 12 14 16 

x(m) 



Fig. 7. Neither hypothesis regarding cue-based versus memory-based navigation fit all bat trajectories. While the mean 
trajectories in Fig. |6] do not exhibit much of an excursion into the woods, we display here the mean paths of the 35% of 
the bats that penetrate more than two meters beyond the vine into the woods (black and green) versus the mean paths of the 
65% that do not venture that far (red and blue). 

VI. Discussion and Summary 

This paper has given a snapshot summary of an interdisciplinary research effort by a team of 
biologists, computer scientists, and control theorists aimed at understanding the flight behaviors 
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of bats — more specifically M. velfier. The aim of the research has been twofold. One goal is 
to develop principles of navigation and flight control for UAVs that exhibit the agility and 
efficiency of animal flyers. An important second goal is to use synthesized flight behaviors to 
make inferences about the mechanisms of sensorimotor control employed by the bats to move 
through their habitat. Section |V] reports preliminary results on analysis and interpretation of 
flight behaviors created by sequences of simple vision-based steering laws. Due to the limited 
space allowed in this paper, we have not been able to discuss many results of the research — 
including a detailed statistical characterization of the geometric diversity of the bat trajectories 
described in Section [11} These results will be presented elsewhere. Our current work is aimed at 
developing a richer set of control primitives that will expand the set displayed in Table 1 and 
allow enhanced parametric studies of flight behaviors. The work reported has been primarily 
concerned with vision-based navigation, but future research will study how species such as 
M. velifer might implement flight control that is primarily based on echolocation. Research is 
being planned to observe bats in flight domains where evidence for preferring one or the other 
sensing modality can be obtained together with a deeper understanding of how these sensory 
modalities are integrated. 
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